Audio-Visual Integration in a Redundant Target Paradigm: A Comparison between Rhesus Macaque and Man.

The mechanisms underlying multi-sensory interactions are still poorly understood despite considerable progress made since the first neurophysiological recordings of multi-sensory neurons. While the majority of single-cell neurophysiology has been performed in anesthetized or passive-awake laboratory animals, the vast majority of behavioral data stems from studies with human subjects. Interpretation of neurophysiological data implicitly assumes that laboratory animals exhibit perceptual phenomena comparable or identical to those observed in human subjects. To explicitly test this underlying assumption, we here characterized how two rhesus macaques and four humans detect changes in intensity of auditory, visual, and audio-visual stimuli. These intensity changes consisted of a gradual envelope modulation for the sound, and a luminance step for the LED. Subjects had to detect any perceived intensity change as fast as possible. By comparing the monkeys' results with those obtained from the human subjects we found that (1) unimodal reaction times differed across modality, acoustic modulation frequency, and species, (2) the largest facilitation of reaction times with the audio-visual stimuli was observed when stimulus onset asynchronies were such that the unimodal reactions would occur at the same time (response, rather than physical synchrony), and (3) the largest audio-visual reaction-time facilitation was observed when unimodal auditory stimuli were difficult to detect, i.e., at slow unimodal reaction times. We conclude that despite marked unimodal heterogeneity, similar multisensory rules applied to both species. Single-cell neurophysiology in the rhesus macaque may therefore yield valuable insights into the mechanisms governing audio-visual integration that may be informative of the processes taking place in the human brain

Optimal Control of Saccades by Spatial-Temporal Activity Patterns in the Monkey Superior Colliculus

A major challenge in computational neurobiology is to understand how populations of noisy, broadly-tuned neurons produce accurate goal-directed actions such as saccades. Saccades are high-velocity eye movements that have stereotyped, nonlinear kinematics; their duration increases with amplitude, while peak eye-velocity saturates for large saccades. Recent theories suggest that these characteristics reflect a deliberate strategy that optimizes a speed-accuracy tradeoff in the presence of signal-dependent noise in the neural control signals. Here we argue that the midbrain superior colliculus (SC), a key sensorimotor interface that contains a topographically-organized map of saccade vectors, is in an ideal position to implement such an optimization principle. Most models attribute the nonlinear saccade kinematics to saturation in the brainstem pulse generator downstream from the SC. However, there is little data to support this assumption. We now present new neurophysiological evidence for an alternative scheme, which proposes that these properties reside in the spatial-temporal dynamics of SC activity. As predicted by this scheme, we found a remarkably systematic organization in the burst properties of saccade-related neurons along the rostral-to-caudal (i.e., amplitude-coding) dimension of the SC motor map: peak firing-rates systematically decrease for cells encoding larger saccades, while burst durations and skewness increase, suggesting that this spatial gradient underlies the increase in duration and skewness of the eye velocity profiles with amplitude. We also show that all neurons in the recruited population synchronize their burst profiles, indicating that the burst-timing of each cell is determined by the planned saccade vector in which it participates, rather than by its anatomical location. Together with the observation that saccade-related SC cells indeed show signal-dependent noise, this precisely tuned organization of SC burst activity strongly supports the notion of an optimal motor-control principle embedded in the SC motor map as it fully accounts for the straight trajectories and kinematic nonlinearity of saccades

Linear ensemble-coding in midbrain superior colliculus specifies the saccade kinematics

Recently, we proposed an ensemble-coding scheme of the midbrain superior colliculus (SC) in which, during a saccade, each spike emitted by each recruited SC neuron contributes a fixed minivector to the gaze-control motor output. The size and direction of this ‘spike vector’ depend exclusively on a cell’s location within the SC motor map (Goossens and Van Opstal, in J Neurophysiol 95: 2326–2341, 2006). According to this simple scheme, the planned saccade trajectory results from instantaneous linear summation of all spike vectors across the motor map. In our simulations with this model, the brainstem saccade generator was simplified by a linear feedback system, rendering the total model (which has only three free parameters) essentially linear. Interestingly, when this scheme was applied to actually recorded spike trains from 139 saccade-related SC neurons, measured during thousands of eye movements to single visual targets, straight saccades resulted with the correct velocity profiles and nonlinear kinematic relations (‘main sequence properties– and ‘component stretching’) Hence, we concluded that the kinematic nonlinearity of saccades resides in the spatial-temporal distribution of SC activity, rather than in the brainstem burst generator. The latter is generally assumed in models of the saccadic system. Here we analyze how this behaviour might emerge from this simple scheme. In addition, we will show new experimental evidence in support of the proposed mechanism

Learning the Optimal Control of Coordinated Eye and Head Movements

Various optimality principles have been proposed to explain the characteristics of coordinated eye and head movements during visual orienting behavior. At the same time, researchers have suggested several neural models to underly the generation of saccades, but these do not include online learning as a mechanism of optimization. Here, we suggest an open-loop neural controller with a local adaptation mechanism that minimizes a proposed cost function. Simulations show that the characteristics of coordinated eye and head movements generated by this model match the experimental data in many aspects, including the relationship between amplitude, duration and peak velocity in head-restrained and the relative contribution of eye and head to the total gaze shift in head-free conditions. Our model is a first step towards bringing together an optimality principle and an incremental local learning mechanism into a unified control scheme for coordinated eye and head movements

Saccadic Eye Movements Minimize the Consequences of Motor Noise

The durations and trajectories of our saccadic eye movements are remarkably stereotyped. We have no voluntary control over these properties but they are determined by the movement amplitude and, to a smaller extent, also by the movement direction and initial eye orientation. Here we show that the stereotyped durations and trajectories are optimal for minimizing the variability in saccade endpoints that is caused by motor noise. The optimal duration can be understood from the nature of the motor noise, which is a combination of signal-dependent noise favoring long durations, and constant noise, which prefers short durations. The different durations of horizontal vs. vertical and of centripetal vs. centrifugal saccades, and the somewhat surprising properties of saccades in oblique directions are also accurately predicted by the principle of minimizing movement variability. The simple and sensible principle of minimizing the consequences of motor noise thus explains the full stereotypy of saccadic eye movements. This suggests that saccades are so stereotyped because that is the best strategy to minimize movement errors for an open-loop motor system

The Validity of d′ Measures

Subliminal perception occurs when prime stimuli that participants claim not to be aware of nevertheless influence subsequent processing of a target. This claim, however, critically depends on correct methods to assess prime awareness. Typically, d′ (“d prime”) tasks administered after a priming task are used to establish that people are unable to discriminate between different primes. Here, we show that such d′ tasks are influenced by the nature of the target, by attentional factors, and by the delay between stimulus presentation and response. Our results suggest that the standard d′ task is not a straightforward measure of prime visibility. We discuss the implications of our findings for subliminal perception research

A global effect of capture saccades

When two target elements are presented in close proximity, the endpoint of a saccade is generally positioned at an intermediate location ('global effect'). Here, we investigated whether the global effect also occurs for eye movements executed to distracting elements. To this end, we adapted the oculomotor capture paradigm such that on a subset of trials, two distractors were presented. When the two distractors were closely aligned, erroneous eye movements were initiated to a location in between the two distractors. Even though to a lesser extent, this effect was also present when the two distractors were presented further apart. In a second experiment, we investigated the global effect for eye movements in the presence of two targets. A strong global effect was observed when two targets were presented closely aligned, while this effect was absent when the targets were further apart. This study shows that there is a global effect when saccades are captured by distractors. This 'capture global' effect is different from the traditional global effect that occurs when two targets are presented because the global effect of capture saccades also occurs for remote elements. The spatial dynamics of this global effect will be explained in terms of the population coding theory. © 2011 Springer-Verlag